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IMAGING SYSTEM PERFORMANCE MEASUREMENT 

Field of the Invention 

The present invention relates generally to the analysis of imaging systems and, in 
particular, to registering an image formed' by the imaging system with an imdistorted 
digital version of the image, before performing image analysis/ The generation of a test 
5 chart with a dyadic pattem for use during the registration and image analysis is also 
disclosed. 

Background 

There is a general need for measuring the performance of an imaging system. 
For example, it is often useful to know how certain image properties vary with scale. The 
10 results from such performance measurement may be used for selecting between 
alternative implementations of the imaging systems. 

Until recently the measurement of the performance of imaging systems has 
primarily been mediated by human visual mterpretation. For example, the performance 
of an imaging system may be measured by imaging a test chart containing a test pattem 
15 with the imaging system under test, and then comparing the properties of the test pattem 
appearing in the captured image with the known properties of die test pattem. 

For instance, a process for detemiining the resolving power of a camera, which is 
a property of the performance of tiie camera, involves taking a photographic knage of a 
standard resolution test chart and visually mspecting the image to extract from the image 
20 the resolving power of the camera. Similarly, the perfomaance of a printing system may 
be measured by printing a known test pattem, and comparing the properties of the printed 
version of the test pattem with the properties of the test pattem. 
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A common property of the above described processes \ised for measuring the 
performance of an imaging system is that a test pattern with known properties is visually 
analysed to characterize the properties of the imaging system. 

Some known test charts are designed for measuring a single property of the 

5 imaging system, such as the resolution of the imaging system, or the modulation transfer 
function (MTF) thereof. Other known test charts are designed for measuring multiple 
properties of the imaging system, with each property being measured from a separate part 
of the image. An example of a current process is the ISO standard 12233:2000, entitled 
''Photography - Electronic still-picture cameras - Resolution measurements'', which 

10 dejBnes a test chart with sequences of black and white bar patterns for measuring contrast 
over a range of spatial frequencies. The pattern on that test chart is primarily designed for 
human visual interpretation with most of the imaging area containing a white background 
with sparsely distributed single frequency patterns. Automation of the process sunply 
mimics the human interpretation; essentially finding the highest frequency pattern with 

15 visible contrast. 

A disadvantage shared by the above described processes is that only a small 
amount of information about the perfomiance of the imaging system is obtained. 
Typically multiple different test charts have to be hnaged and visually analysed to obtain 
different properties of the performance of the imaging system, A further disadvantage of 

20 the above described processes is that they are not amenable to automation. 

Recent advances m digital and electronic imaging have meant that automated 
measurement of the performance of an imaging system has become more common. For 
example, during the evaluation of image compression processes, such as those usuig the 
JPEG and MPEG compression algorithms, a pixel-by-pixel comparison is made between 

25 an image before compression, and that after the compression process has been performed 
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on the image. This form of measmement of the perfoimance of an imaging system is 
simplified by the fact that the pixels of the images bemg compared are related, in that the 
compression process only changes pixel values, not pixel locations. In other words, no 
geometric distortion occurs during the compression process. 

5 The range of image quality parameters calculable in such an imaging system is 

immense because, in essence, the imaging s>^tem may be considered to be an imagmg 
system where each pixel is an independent channel. In practice a small number of 
mathematical image quality parameters are calculated, such as mean squared error (MSB) 
and peak signal to noise ratio (PSNR), as well as human visual system (HVS) related 

10 parameters. In the area of measurement of performance j&om digital images and video 
images it is almost taken for granted that the original (uncompressed) image is known and 
available for comparison with the compressed image. 

However, in imaging situations other than pure compression, the output image 
cannot be directly compared to the input image because a geometrical transformation, or 

15 distortion, occurs in the imaging system. For example, when a digital camera captures an 
image of an ISO test pattem, the exact magnification, orientation and perspective 
parameters are not known a priori, nor are those parameters easily controlled or fixed, 
except m laboratory controlled research environments. So, in such systems it is not, in 
general, possible to perform a direct comparison of input and output images because the 

20 images are not congruent. 

Furthennore, currently available test charts typically have different sized regions 
spatially ordered and separated. This kind of structure makes accurate alignment between 
input and output images for comparison variable, in that larger sized regions do not align 
well due to their lack of texture. As a result such currently available test charts can not be 
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used to estimate geometric distortion, although their ability to estimate quaUties such as 
colour is unaltered. 

Another disadvantage shared by most currently available test charts is that they 
lack spatial frequency distribution, especially when compared with natural images, such 
as landscapes, faces, natural objects, etc. This is mainly due to the regular or grid Uke 
distribution of regions on such test charts. Accordingly, even thou^ such test charts are 
useful for measuring specific quaUties of an imaging system, such as the colour or 
regions, other properties such as resolution are difficult to estimate fiom the same regions. 

It is often advantageous to compare corresponding regions of input and output 
images using higher level descriptors, such as texture, colour, spatial frequency. 
However, if a distortion occurred between the mput image and the output image as a 
result of the imaging system, regions can not be compared, as such regions are not 
guaranteed to be corresponding regions. 

Summary 

It is an object of the present invention to substantially overcome, or at least 
ameliorate, one or more disadvantages of existing arrangements. 

Disclosed are arrangements which seek to address one or more of the 
disadvantages of existing arrangements by registering input and output images through 
precisely defining the geometrical transformation, or distortion, required to bring the 

knages into congraence. 

According to a first aspect of the present disclosure, there is provided a method of 
measuring performance parameters of an imaging device, said method comprising the 
steps of: 

maintaining a test pattern image, said test pattern image comprising alignment 
features and image analysis features; 
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imaging a test chart using said imaging device to form a second image, said test 
chart containing a representation of said test pattern image; 

registering said test pattern image and said second image using block based 
correlation operating on said aligmnent features; and 
5 measuring said performance parameters by analysing said image analysis features. 

According to a second aspect of the present disclosure, there is provided a method 
of measuring performance parameters of a printer, said method comprising the steps of: 

maintaining a test pattern image, said test pattern image comprising alignment 
features and image analysis features; 
10 printing said test pattern image using said printer to form a test chart; 

imaging said test chart using a calibrated imaging device to form a second image; 

registering said test pattem image and said second image using region based 
matching operating on said aUgjmient features; and 

measuring said performance parameters by analysing said image analysis features. 
15 According to yet another aspect of the present disclosure, there is provided a 

method of generating a test pattern, said method comprising the steps of: 

(a) dividing an image area into a predetermined number of areas; 

(b) dividing each of said areas into smaller areas; 

(c) within each area, assigning properties to at least one of said smaller areas, and 
20 designating the remainder of said smaller areas as areas; 

(d) generating pixel values for sad at least one of said smaller areas, said pixel 
values being in accordance with said properties; 

(e) repeating steps (b) to (d). 

According to yet another aspect of the present disclosure, there is provided an 
25 apparatus for implementing any one of the aforementioned methods. 
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According to yet another aspect of the present disclosure there is provided a 
computer program product having recorded thereon a computer program for 
implementing any one of the methods described above. 

Other aspects of the invention are also disclosed. 

5 Brief Description of the Drawings 

One or more embodiments of the present invention will now be described with 

reference to the drawings in which: 

Fig. 1 illxastrates an arrangement for measuring the performance of a scanning 

device; 

,0 Fig. 2 illustrates an arrangement for measuring the performance of a printer; 

Fig, 3 illustrates an arrangement for measuring the performance of the optical 

imaging system of a camera; 

Fig. 4 shows a schematic block diagram of the general-purpose computer; 

Fig. 5 shows an example one-dimensional scale invariant pattern; 
^5 Fig. 6 shows a representation of an example of a one-dimensional scale mvariant 

pattern extended in the transverse direction to cover a defined image area; 

Fig. 7 shows an example alignment pattem image, which is a superposition of 
four one-dimensional scale invariant patterns, each similar to the example one- 
dbnensional scale invariant pattem shown in Fig. 6 but with different radius r. and angle 

20 a; parameters; 

Fig. 8 shows the preferred configuration the axes of symmetry of four one- 
dimensional scale invariant pattem embedded in the alignment pattem shown m Fig. 7; 

Fig. 9 shows an example test pattem that consists of both a spread-spectrum 
alignment pattem and a high firequency noise pattem; 
25 Fig. 10 shows the intersection points of the axes of symmetry shown in Fig. 8; 
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Fig. 1 1 shows a flow diagram of a method of generating a dyadic test pattern; 
Fig. 12A shows an example test pattern consisting of tiles having frequency 
responses and orientation covering a predetermined range; 

Fig. 12B shows an example test pattem derived from the test pattern shown in 
5 Fig. 12A, but with the spatial locations of the tiles randomly permuted; 

Fig. 13 shows a schematic flow diagram of a method of registering two digital 
images, and then analysing the registered images in order to determine characteristics of 

an imaging system under test; 

Fig. 14 shows a schematic flow diagram of a preferred implementation of the 

1 0 coarse registration performed in the melliod of Fig. 1 3 ; 

Fig. 15 shows a schematic flow diagram of rotation, scale and translation 
registration performed during the coarse registration shown in Fig. 14 in more detail; 

Fig. 16 shows a schematic flow diagram of transforming an image into a 
complex image as performed in the rotation, scale and translation registration shovra in 

15 Fig. 15 in more detail; 

Fig. 17 shows a schematic flow diagram of generating from a complex image an 
image that is substantially invariant to translations as perfomied in the rotation, scale and 
translation registration shown in Fig. 15 in more detail; 

Fig. 18 illustrates some characteristics of resampling an image having Cartesian 
20 coordinates to an image in the log-polar domain; 

Fig. 19 shows a schematic flow diagram of invariant pattem detection performed 
during the coarse registration shown in Fig. 14 in more detail; 

Fig. 20 shows a schematic flow diagram of the preferred method of resampling a 
Fourier Transform mto a quasi-polar frequency space; 
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Fig. 21 shows a schematic jElow diagram of the steps for performing block based 
coirelation; 

Fig, 22 illustrates two images and the positions of first tiles within those images 
when performing block based correlation; 
5 Fig. 23 illustrates the conversion from a grey scale test pattem to a CMYK test 

pattern; 

Fig. 24 shows a schematic flow diagram of the steps for perfonning 
interpolation; 

Fig. 25 shows a schematic flow diagram of the steps for detecting positions of 
10 peaks in a correlation image; 

Fig. 26 illustrates the warping of pixel labels. 

Detailed Description including Best Mode 

Where reference is made in any one or more of the accompanying drawings to 
steps and/or features, which have the same reference numerals, those steps and/or features 
15 have for the purposes of this description the same function(s) or operation(s), unless the 

contrary intention appears. 

Some portions of the description which follows are explicitly or implicitly 
presented in terms of algorithms and symboUc representations of operations on data 
within a computer memory. These algorithmic descriptions and representations are the 

20 means used by those skilled in the data processing arts to most efifectively convey the 
substance of their work to others skilled m the art. An algorithm is here, and generally, 
conceived to be a self-consistent sequence of steps leading to a desired result The steps 
are those requiring physical manipulations of physical quantities. Usually, though not 
necessarily, ttiese quantities take the form of electrical or magnetic signals capable of 

25 being stored, transferred, combined, compared, and otherwise manipulated. 
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Unless specifically stated otherwise, and as apparent firom the following, it will 
be appreciated that throughout the present specification, discussions utilizing terms such 
as "scanning^', "calculating'\ "determining", "replacing", "generating" "initiaUzing", 
"outputting", or the like, refer to the action and processes of a computer system, or similar 

5 electronic device, that manipulates and transforms data represented as physical 
(electronic) quantities within the registers and memories of the computer system into 
other data similarly represented as physical quantities within the computer system 
memories or registers or other such information storage, transmission or display devices. 

When evaluating a general imaging system, an image is (re-)produced by the 

10 imaging system firom a master image. The two images are than compared by calculating 
mathematical image quality parameters, hi order for the mathematical unage quality 
parameters to be calculated, it is necessary for the images to be registered or aUgned. 
Hence, it is necessary to precisely define the geometrical transformation, or distortion, 
required to bring the images into congruence. The distortion itself is also an hnportant 

15 quality measure of the imaging system. Also, with the distortion appUed by the imaging 
system known, attempts may be made to correct images produced by the imaging system. 

Precise image registration is also a principal requirement of high quality colour 
printing processes where the diflforent colour channels have to be aligned precisely. The 
mis-registration is usually of the shnplest kind, that is to say a translation or shift in 

20 mathematical terminology. Conventionally registration marks, such as crosses, are 
printed on the printing medium and just outside ttie main image area in an attempt to 
achieve precise registration of the colour channels. The crosses are usually composed of 
two thin lines which clearly show any misaligmnent of the printed colour charaiels. 

An alternative approach is to include ahgnment patterns, not spatially locahsed 

25 patterns like crossed lines, but distributed patterns like ^read spectrum noise or 
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mathematical patterns with special spatial and spectral properties, into the test pattern. 
Such alignment patterns may be embedded at low levels, so that they are not necessarily 
visible to the human eye, yet are still detectable by mathematical procedures such as 

matched filtering or correlation. 

5 Unlike the printing process where the distortion is a relative translation between 

chamiels, the distortion occurring in more general imaging systems, such as a camera, 
may also vary spatially. In fact, the most common types of distortion in cameras depend 
on the lens of the camera. Such distortions include barrel or pin-cushion distortion, and 
perspective distortion. If the outward radial distortion increases with the distance from 

10 the image centre the distortion is called pin-cushion distortion, whereas if the inward 
distortion increases with distance from the image centre then the distortion is called barrel 
distortion. 

Using traditional methods, it would be necessary to include registration marks 
throughout the image area to allow complete image registration. This is possible, and 

15 indeed some of the test patterns described below include registration marks througjiout 
the test pattern, which is then imaged. However, it is not necessary to explicitly embed 
such registration marks into the test pattem if the test pattern itself has a stnicttire which 
may be called an "intrinsically alignable structure". Mathraiatical analysis of alignment 
processes shows that test patterns in an image are intrinsically alignable if the test patterns 

20 have a vride Fourier spectral content. In particular, a wide Fourier spectral content 
ensures that correlation based registration gives sharp, low noise alignment 

From the preceding discussion it is clear that the use of a suitable test pattem 
may allow both precise image alignment and image quality metric evaluation on a pixel- 
to-pixel basis. One of the significant advantages of such an approach is that a correlation- 

25 based alignment process may be used, which is perfect for automation. 
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Fig. 1 illustrates an arrangement 100 for measuring the performance of a 
scanning device, such as digital scanner 120. The digital scanner 120 may be any type of 
digital scanner, such as a flatbed scanner, a photocopier with scanner functionality, a 
drum scanner or the like. The digital scanner 120 interfeces to a general purpose 
5 computer 200. 

Fig. 4 shows a schematic block diagram of the general purpose computer 200, 
The computer 200 is formed by a computer module 201, input devices such as a 
keyboard 202 and mouse 203. and a display device 214. The conq)uter module 201 
typically includes at least one processor unit 205, and a memory unit 206. The 
10 module 201 also includes an number of input/output (I/O) interfaces including a video 
interface 207 that couples to the display device 214 and loudspeakers 217, an I/O 
interface 213 for the keyboard 202 and mouse 203, and an interface 208 for interfecing 
with devices external to the computer 200, such as the digital seamier 120 (Fig. 1). 

A storage device 209 is provided and typically iacludes a hard didc drive 210 
15 and a floppy disk drive 2 1 1 . A CD-ROM drive 212 is typicaUy provided as a non-volatile 
source of data. The components 205 to 213 of the computer module 201, typically 
communicate via an interconnected bus 204 and in a manner which results in a 
conventional mode of operation of the computer system 200 known to those in the 
relevant art. 

20 Referring to Figs. 1 and 4, the arrangement 100 is controlled so that iJie digital 

scanner 120 scans a calibrated test chart 110 containing a test pattern to form a digital 
image of the test pattem. An advantage of using test charts instead of images containing 
natural scenes when performing image quality assessment is that control is gained ovct 
the structure of the input image because, as is weU known fix)m video sequence analysis 

25 theory, image registration is generally difficult in image regions having Uttle texture. By 
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appropriate design of the pattern appearing on the test charts, adequate texture caa be 
assured in image regions that require registration. 

The digital image of the test pattern is typically stored on the memory 206 of the 
general purpose computer 200. The general purpose computer 200 also holds in its 
5 memory 206 a digital representation of the test pattern appearing on the test chart 1 10 as a 
test pattern image. Both images, those being the image foraied by the scanner 120 from 
the test chart and the test pattern image, are stored in the memory 206 as a raster array of 
pixel values of some fibced precision or floating point data type with a horizontal and 
vertical dimension. The images are generally colour images, though the registration 
10 process described below is generally apphed to only a single channel derived from the 
other chaxmels, such as the luminance of the image. 

The calibrafed test chart 110 is produced beforehand from the test pattern 
through a process such as printing, etching, or other means. To be useful in the analysis 
of the performance of an imaging system, the calibrated test chart 1 10 must be produced 
15 by a sufficiently accurate process such that the spatial errors in the caUbrated test chart 
1 10 are much smaller than those expected from the imaging system. Etching is preferably 
used for measuring the performance of the scanner 120 where high precision is required, 
such as the measurement of the modulation transfer ftmction (MTF) of the scanner 120, 
whereas printing is used for producing test charts 1 10 for use in the measurement of 
20 characteristics that requure less precision. 

After obtaining a digital image of the test pattern on the test chart 110 using the 
scanner 120, the general purpose computer 200 is then controlled to register the digital 
image from the scanner 120 and the test pattern image, and to analyse the registered 
images in order to determine at least one characteristic of the scanner 120. The method 
25 used for registering and analysing the images is described in detail below. 
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Fig, 2 illustrates an arrangement 101 for measuring the performauce of a printer 
130. The printer 130 may be any type of printer, such as a laser beam printer, an inkjet 
printer, a dye sublimation printer or the like. In this arrangement 101 the printer 130, as 
well as a caUbrated digital scanner 140, are interfaced to the general purpose computer 
5 200, described in detail with reference to Fig, 4, through I/O interface 208. 

In operation the printer 130 receives a test pattern &om the computer 200 and 
prints a test chart 150 containing the test pattern. The test chart 150 is then scanned usmg 
the cahbrated scanner 140 in order to form a digital image of the test pattern, which is 
typically stored on the memory 206 of the general purpose computer 200. 
10 The general-purpose computer 200 is then controlled to register tiie digital image 

from the caUbrated scanner 140 and an image of the test pattern, and to analyse the 
registered images in order to determine at least one characteristic of the printer 130. The 
method used for registering and analysmg the itnages is described in detail below. 

Fig. 3 illustrates an arrangement 102 for measuring the performaace of the 
15 optical imaging system of a camera 160. hi this arrangement 102 the camera 160 
interfaces with the general-purpose computer 200 through I/O interface 208. 

The camera 160 is controlled to capture an unage of a calibrated test chart 170 
containing a test pattem. The caUbrated test chart is formed hi the manner described with 
reference to Fig. 1. The unage of the caUbrated test chart is then transferred to the general 
20 purpose computer and stored in memory 206, The general-purpose computer 200 is then 
controlled to register the image from the camera 160 and an image of the test pattem 
appearing on the calibrated test chart, and to analyse the registered images in oxd&r to 
determine at least one characteristic of the optical unaging system of the camera 160. 
The method used for registermg and analysing the unages is described in detail below. 
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In airangement 102 it is possible to use a self-luminous device, such as a liquid 
crystal display (LCD) or cathode ray tube (CRT) display, instead of a more conventioiial 
reflective or transmissive test chart which requires external iUumination. In fact, the LCD 
or CRT display may be the display device 214 shown in Fig. 4 and fomiiag part of the 

5 general computer system 200. A major advantage of using an LCD as test chart 170 is 
that LCD's are fabricated by micro-lithographic techniques on flat glass, which ensures 
extremely good dimensional accuracy and stability, especially when compared to printed 
test charts. An advantage of using either of the LCD or CRT display as test chart 170 is 
that changing the test pattern is just a matter of changing the signal sent to the display, so 

10 that numerous different test patterns may be used. It is also possible to rapidly display a 
sequence of different test patterns. 

In an arrangement not illustrated the performance of the optical imaging system 
of an analogue (fihn) camera may be measured by capturing a photograph of the 
calibrated test chart 170, developing the photograph, then scanning the photogr^h using 

15 a caUbrated scanner such as scanner 140 (Fig, 2) to form an image of the test pattem on 
the calibrated test chart, registering the image of the test pattem on the calibrated test 
chart and an image of the test pattern, and analysing the registered images in order to 
deteixnine at least one characteristic of the optical imaging sj^tem of the analogue 
camera. 

20 It can be seen that in each of the arrangements described with reference to Figs 1 

to 3 two images are formed, a first being a digital representation of a generated test 
pattem, and the second being a captured hnage containing the same test pattem. The 
precise format of tlie test pattem used in each instance depends on the characteristic of the 
imaging system that is to be measured. 
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Before describing tiie steps of registering the images and aaalysing the registered 
images in order to detemaine characteristic of the imaging system under test, be it the 
scanner 120 (Fig, 1), the printer 130 (Fig, 2), tiae optical imaging system of the camera 
160 (Fig. 3), or the optical imaging system of the analogue camera (not illustrated), the 
5 generation of a number of test pattems for use in the registration and analj^is of the 
images is first described. 

The methods of generating test pattems are preferably practiced using the 
general-purpose computer 200 shown in Fig. 4 wherein the processes of generating the 
test pattems are implemented as software, such as an application program executing 

10 within the computer 200. In particular, the steps of generating the test pattems are 
effected by instructions in the software that are carried out by the computer. Typically 
the appUcation program is resident on the hard disk drive 210 and read and controlled in 
its execution by the processor 205. Intermediate storage of the program and the storage 
of the generated test pattem may be accompUshed using the memory 206, possibly in 

1 5 concert with the hard disk drive 210, 

Each of the test pattems is gen^ated by the general-purpose computer 200 as a 
digital image, which is defined on a raster grid of N pixels by M pixels in the horizontal 
and vertical directions respectively. Bach pixel of the test pattems is generally a colour 
pixel in some colour space, such as a linear RGB or CMYK coloiir space. Pixel values 

20 are preferably integer values in the range of 0 to 255. The test pattem may be converted 
to a single channel image based on the luminance of the colour pixels. 

Two coordinate systems are defined for the test pattem images. The first is an 
offset coordinate systrai where the location of each pixel is measured relative to the upper 
left comer of the image. The second is a Cartesian coordinate system where the x -axis is 

25 along the horizontal dimension of the image, the y -axis is along the vertical dimension of 
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the image, a unit displacement in the Cartesian coordinates represents a single pixel 
displacement on the image, and the origin of the Cartesian coordinates lies at pixel offset 

. Note that where the Fourier Transform is \ised, it is assumed that the 
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the Nyquist frequency (for images with even width and height) is positioned at pixel 

offset (0,0). The forward and inverse Fourier Transforms are normalised such that the 

inverse Fourier Transform is divided by a scaling factor of 1/(N>^M) and the forward 

Fourier Transform has a scaling factor of unity (no scaling), 
10 Also, where interpolation is used throughout, it is assumed that half sample 

symmetric reflective boundary conditions are used to extend the image to allow 

interpolation of pixels at the edge of the image. 

The first test pattern described here is a test pattem used in dete rminin g spatial 

inaccuracies in the inmging system under test. The test pattem consists of two 
15 superimposed patterns, those being an alignment pattern, and a pseudo-random noise 

pattem. 

The alignment pattem in tum is a superposition of four one-dimensional scale 
invariant patterns, with each one-dimensional scale invariant pattem extended in a 
transverse direction to cover a defined image area. A one-dimensional basis function 
20 from which each one-dimensional scale invariant pattem may formed is: 

/ (X) = COS(;^ lOgj^ - Xq |) (1) 

where is a constant that specifies how quickly the pattem oscillates and Xq 
specifies the symmetry point for the pattem. The reason flhe basis flmction is temied a 
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"scale invariant" pattern is because the pattern, when correlated with a scaled version 
thereof, still forms a correlation peak. An example one-dimensional scale invariant 
pattern is represented in Fig, 5. Each one-dimensional scale invariant pattem fiix^) that 
has been extended in the transverse direction is specij&ed by two fiirther parameters, 
5 namely a radius ?} , and an angle , as follows: 

fi(Xyy) = cos(;^log|;ccosa,. +^sina,. -r^|) (2) 

wherein the angle is the angle an axis of symmetry of the scale invariant 
pattem/(xj/) forms with the vertical Cartesian axis, and the radius is the distance from 

the Cartesian origin to the axis of symmetry. Each one-dimensional scale invariant 
10 pattem ^(;c^y) also has a Nyquist radius, which is the number of pixels from the axis of 
symmetry of the pattem where the frequency of the pattem is equal to the Nyquist 
frequency of the image. Pixel values within tihe Nyquist radius from the axis of symmetry 
are attenuated. An example of a one-dimensional scale invariant pattem extended 
in the transverse direction to cover the image area is shown in Fig. 6, together with the 
15 parameters radius and angle , and the axis of symmetry. A rq)resentation of an 
example alignment pattem image, which is a superposition of four one-dimensional scale 
invariant patterns Jiipcod^ each similar to the example one-dimensional scale invariant 
pattem shown in Fig. 6 but with different radius and angle parameters, is shown in 

Fig. 7. In the representation pixel values have been binarized. 
20 The preferred values of the radius and angle parameters for the one- 

dimensional scale invariant patterns are: 
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with 



P. =:max(256,min(A^,M))/(2 + V2) 



(4) 



and where the Nyquist radius is R^q ^ 50 . This set of parameters r/ and Oi has 

5 been specially chosen so that the axes of symmetry of the one-dimensional scale invariant 
patterns f^x^) intersect at points that define line segments that have certain ratios of 
lengths. The ratios of lengths are invariant under aflfine transformations. 

From the preferred parameters above, the configuration of the axes of symmetry 
of the four one-dimensional scale invariant patterns f^x^) embedded in the alignment 

10 pattem is shown in Fig. 8. 

For a test pattem with dknensions N pixels by M pixels, the following quantities 
are pre-calculated for each one-dimensional scale invariant pattem fix^) having 

parameters and : 
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+ r^cos<a:, 



-{Xf cos a,- + 7; sina;)/D; 
= R^yQ max(256,min(iV^,M))/256 



(5) 
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The contribution of pattern ^-Jc^y) to the pixel of the aligoment pattern at offset 
(x^) is Pi (x, y) , and is given by: 

i? = i?; 4- (y sina + xcosa)/Df 
if(\R\>R,,YQmd\R\>R^) 



-0.5 



elseif(\R\ > R^yQ aiid|i?| <=/?,,) (6) 
P, {x,y) = cos(;iR^g log(i^|)) 

else 

The pixel values of the alignment pattern are then, calculated as follows: 



P(.x,y) = '£P,ix,y) (7) 



The test pattern is generated by adding the raster array of real values representing 
the alignment pattern, that isP(A;,>'), to a pseudo-random noise pattern. The preferred 
generator of the pseudo-random noise pattern generates values in the range -1 to 1, and 
tlie test pattern value at coordinate (x^), denoted RGBix.y) , maybe obtained through: 

K^. y) = {random{x, y, s) + 0.025P(x, 3;)) 
^max =max(r(x,y)) 

t^^^ ^minOCx,;^)) (8) 
Yix, y) - 256(^(jc, y)'-t^) Kt^ - ) 
RGBix.y) = iYix,y)ilYix,y)^lYix,y)!j 

where rando7n{x,y,s) represents the random value generated for the pixel at 
coordinate {x^) and using seed value s. Hence an RGB pixel value is formed for each 
pixel in the test pattem, the RGB pixel value representing a grey level that is determined 
by addkig 0.025 times the alignment pattem pixel value Pix.y) to the random number 
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geaerated for that pixel, aad then renormalising and quantising the entire image so that it 
takes on integer values between 0 and 255. 

The test pattern generated using the process described above is a grey scale test 
pattern that has both a spread-spectrum aUgnment pattem that may be used to determine 

5 approximate translation, rotation and scaling transformations of the captured test pattem 
efficiently, and a high frequency noise pattern, generated by the pseudo-random noise 
generator, that allows very fine spatial registration. A binarized representation of an 
example test pattem is shown in Fig. 9. 

Translation, rotation and scaling are known as afiOne transformations. A 

10 property of afEine translations is that lines are transformed to lines. Accordingly, when 
the axes of symmetry of the patterns forming the aligmnent pattem imdergo an afBne 
transformation, then the transformed alignment pattem will still have axes of symmetry 
tlaerein, with only the configurations of ttie axes of symmetry of the respective patterns 
transformed to different configurations. 

15 Xhe pattem detection process described below uses this property of affine 

transformation by identifying the positions and angles of the axes of symmetry in the 
transformed alignment pattern, allowing the determination of parameters defining the 
aflBbie transform that has been applied to the image containing the alignment pattem. 
Rather than analyse the parameters of the axes of symmetry directly, the method 

20 described below analyses the points of intersection of the axes of symmetry, which are 
shown in Fig. 10, and in particular the ratios of line lengths joining the points of 
intersection of the axes of symmetry, which are invariant to afl5ne transformations. 

As noted, the test pattem generated using the process described above is a grey 
scale test pattem. In the case where different colour channels are to be aligned, such as 

25 the case where the CMYK colour space channels of a printer are to be aligned, it is 
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necessary to use a test pattern containing pixels in the CMYK colour space. Accordingly, 

the grey scale test pattern described above has to be converted into a colour test pattern. 

The conversion starts by the processor 205 dividing the grey scale test pattern 

into a set of 2 by 2 pixel cells. Fig. 23 illustrates the conversion from a grey scale test 
5 pattern 2300 to a CMYK test pattern 23 10. In each of the cells the pixels are labelled as 

Gl, G2, G3, and G4 for the top left, top ri^t, bottom left and bottom right pixels 

respectively. Item 2305 shows one such set of 2 by 2 pixel cells, and the labelling of 

pixels within the cell. 

Corresponding pixels in the test pattern containing pixels in the CMYK colour 
10 space are labelled as CI, M2, 13, and K4 respectively. Each of the pixels represents a 

channel in the CMYK colour space. Item 23 15 shows the cell corresponding to cell 2305, 

and the labelling of pixels within the cell. The set of four pixels together form a colour in 

the CMYK colour space, with the CMYK colour written in the notation (C1M2,Y3^4). 

Next the processor 205 attributes values to each of the pixels in the test pattern containing 
15 pixels in the CMYK colour space, with those values being derived from the values of the 

corresponding set of greyscale pixels. Values for the CI, M2, 13, and K4 pixels are 

attributed as follows: 

CI is given a cyan value of 255 if Gl is greater than 127, and given a value of 0, 

which corresponds to white, if CI is less tl^ or eqxial to 127; 
20 M2 is given a magenta value of 255 if C2 is greater than 127, and given a value 

of 0, which corresponds to white, if G2 is less than or equal to 127; 

13 is given a yellow value of 255 if C3 is greater than 127, and given a value of 

0, which corresponds to white, if C3 is less than or equal to 127; and 

K4 is given a black value of 255 if C4 is greater than 127, and given a value of 0, 
25 which corresponds to white, if 04 is less than or equal to 127. 
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The CMYK test pattern formed in this manner contains pixels having one of 5 
distinct pixel colours, those being white, cyan, magenta, yellow or black. 

A second test pattern described here, tenned a dyadic test pattern, is useful for 
measuring the accuracy of the colour measurements of the imaging system under test. 

5 The dyadic test pattem contains a number of patches. Each of the patches may have a 
known constant, flat colour. Alternately, the dyadic test pattem may contain patches of 
slowly varying colour, patches having a pattem with a speciJBc jtequency distribution 
and/or orientation to measure other aspects of the imaging system's performance, patches 
having pseudo-random noise, or combinations of the above. It is convenient for such 

10 patches to have different sizes within the dyadic test pattem to assist in measuring the 
imaging system's response to different sized input patches. 

Fig. 1 1 shows a flow diagram of a method 700 of generating a dyadic test 
pattem. The patches have different sizes and colour properties, with the properties of the 
patches predetermined dependent on the characteristic of the imaging system that is to be 

15 measured. 

Method 700 starts in step 705 where the processor 205 receives an initial patch 
list, and stores the initial patch Ust in the storage device 209. The initial patch list 
specifies how many similar regions on the test pattem are to be created. Each similar 
region in one implementation contains a single flat patch of colour and multiple smaller 

20 patches of colour, hi another implementation each similar region contains a single patch 
with slowly varying colour and multiple smaller patches, each also with slowly varying 
colour. In yet another implementation each similar region contains a single patch with a 
pattem with a specific firequency distribution and orientation, and multiple smaller 
patches, each also containing a pattem with a specific firequency distribution and 

25 orientatioiL 
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The initial patch list may specify that the dyadic test pattern is to be generated 
containing an 8x8 arrangement of 64 square regions or tiles, each of size 256 pixels by 
256 pbcels, where each region has a single large patch of colour and progressively more 
patches of colour at progressively smaller sizes. 
5 In step 710 the processor 205 determines whether the (initial) patch list is empty. 

If it is determined in step 710 that the patch Ust is empty, method 700 proceeds to step 
750 where method 700 ends. 

Altematively, if the processor 205 determine in step 710 that the patch list is not 
empty, then the method 700 proceeds to step 715 where the processor removes a first 
10 patch from the patch list. Step 720 follows where the processor 205 determines whether 
the patch removed from the patch Ust in step 715 has a width or height of only a single 
pixel. 

If it is determined in step 720 that a dimension of the patch xmder consideration 
is greater that a single pixel, then that patch is subdivided in step 730. In particular, the 

15 patch is subdivided into four smaller patches, with each smaller patch being a square 
covering a quarter of the area of the patch being divided. In the case where the patch 
being divided has a width or height that is an odd number, the patch is divided to form 
smaller patches that are as near as practicable to a quarter of the area of the patch being 
divided. In step 735 that follows the processor 205 selects one of the smaller patches in 

20 such a way so as to avoid any substantial periodicity in the generated test pattern. One 
method that may be employed by the processor 205 to avoid any substantial periodicity in 
the generated dyadic test pattern is to select the smaller patch from the four available 
smaller patches randomly. The unselected patches are added to the patch list in step 740. 
The (smaller) patch selected in step 735 is not subdivided further, and a property, such a 

25 colour, is assigned to that patch in step 745, with the property assigned to the patch being 
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assigaed according to the size and location of the patch under consideration within the 
dyadic test pattern. After step 745 the method 700 returns to step 710. 

Also, if it is determined in step 720 that the patch under consideration does have 
a dimension that is only a single pixel, then that patch is not to be subdivided further, and 
5 a property is assigned to that patch in step 745 as is described above. 

It can be seen that the effect of method 700 is that, each time steps 710 to 745 are 
performed, a patch from the patch list is ranoved, divided into 4 smaller patches, one of 
the smaller patches is assigned a property while the other 3 patches are added to the patch 
hst. This process continues until the patches can no longer be divided. 
10 An example of a manner in which the property of colour may be assigned to a 

patch in step 745 in the case of a dyadic test pattern with an 8x8 arrangement of 64 square 
regions is to assign each of the 64 large patches, resultmg from the initial division of the 
regions, a different shade of grey, and to assign all the other (smaller) patches a random 
colour. 

15 Other multi-scale test patterns may be generated using a mettiod similar to 

method 700 by decomposing other sh^es, other than squares, into collections of smaller 
shapes. For example, triangles may be used as the shapes, and selectively divided into 
smaEer triangles through some pseudo random decision process. 

Multi-scale test patterns have the advantage that, not only do they provide 

20 patches or regions having the required properties, but they also provide for unproved 
alignability due to the induced spatial variation. Closely connected with ttie improved 
alignability is an mcrease in the ^atial frequency content of the test pattern. 

A third test pattern described here is a test pattem having a frequency response 
chosen to provide a good degree of contrast for the imaging system under test, while still 

25 containing a wide range of frequeaicies. As is known ia the art of image analysis, an 
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image is generally aligaable if the image contains a pattern with a wide Fourier spectrum. 
For this reason pattern having a frequency spectrum that is flat is often chosen. 

However, a flat frequency spectrum also has a number of disadvantages in some 
limited circumstances. One disadvantage results from the fact that a pattern having a- flat 

5 frequency spectrum, even when printed in binary, has high frequency energy which is 
higher than that contained in natural patterns. Natural patterns trad to have a frequmcy 
spectrum that follows a llfrequency curve. If the imaging system attenuates high 
frequencies to any extent, or if the imagmg system captures or represents the test pattem 
at a resolution below that of the digital version of the test pattern, then much of the energy 

10 contained in the high frequencies of the test pattem is lost. This may result in an image of 
the test pattem with very poor contrast, which in tum may interfere with the test of the 
imaging system. For example, the focus mechanism for the camera 160 may not operate 
correctly with a test chart 110 containing a spectrally flat test pattem because the focus 
mechanism cannot detect any strong edges. 

15 An alternative to a test pattem having a flat frequency spectrum is a test pattem 

having a frequency respdnse chosen to provide a good degree of contrast for the imaging 
system, while still containing a wide rangb of frequencies. An example of such a test 
pattem is a random fractal, which may be generated by a variety of means. One such 
means is to create random noise with a spectral distribution of the form: 

20 = ^ I -pfi J 

where the function random is a pseudo-random function operating on a seed s, 
F""* is the inverse Fourier transform, r is flie radial distance from the Fourier origin, and 
parameter p is chosen to have some real value, typically between 1 and 3. In the 
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preferred implementation parameter y3=l, which produces a pattem with fractal dimension 

3 and is highly textured. 

The use of such a test pattem has the advantage that more energy is available in 
the lower frequencies, resulting in an image captured of the test pattem, such as when 

5 scanner 120 or camera 160 are used, or an image printed of the test pattem, such as when 
printer 130 is used, to having more contrast. Because the spectral scaling factor, , is 
scale-invariant, computation of the MTF is made easier than it would be where some non 
scale-invariant scaling factor is used. 

Generally, to allow accurate aUgnment, the test pattem should contain areas with 

10 a large amount of fine detail. The finer the detail, the more distinct each pixel is when 
compared with its neighbours. Regardless of any fine detail contained in the areas, if 
such areas are repetitive or have properties similar to neighbouring areas, then there is a 
probabiUty that areas may be incorrectly registered with neighbouring areas instead, as 
such areas may become mdistinguishable. It is therefore preferable for areas in the test 

15 pattem not to be repetitive. 

In view of the foregoing, a fourth test pattem described here is a test pattem 
wherein the spatial locations of elements v^thin the test pattem are randomly permuted to 
improve registration. For example, consider a test pattem consisting of differently 
coloured tiles, with the tiles all having the same size. It may be required that the colours 

20 of the tiles cover a predetermined range of hues, saturations and brightness in a regular 
manner. According to the fourth test pattem, the colour patches formed are randomly 
permuted so that there is essentially no regularity to the way that the colours of the 
patches change. Tile boundaries within this fourth test pattem are now between tiles with 
colours that are substantially different, producing improved ^tmctures for faciUtating 

25 improved image registration. 
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It is noted that the characteristics of the elements are not limited to colour. For 
example, consider a test pattern consisting of tiles having frequency responses and 
orientation covering a predetermined range, such as the test pattern shown in Fig, 12A* 
As can be seen, nei^bouring tiles have very similar frequency responses and orientation, 

5 which may adversely effect registration. Fig. 12B shows a test pattern wherein the spatial 
locations of the tiles from the test pattern shown in Fig. 12A are random permuted to 
improve registration. 

It is often desirable to measure multiple characteristics of an imaging system 
without the need to produce multiple test patterns, to form test charts from the test 

10 patterns where applicable, to capture an image of each of the test patterns, and then to 
analyse tlie resulting images. To that end it is often advantageous to combine elements 
from different types of test pattOTis onto a single test pattern. It should be apparent that 
different types of test pattems may be combined onto a single test pattern by placing two 
or more test pattems on a single test chart, or by combining elements of these test pattems 

15 in other ways. A person skilled in flie art would imderstand Ihat some combinations of 
test pattems are not pemaissible. For example, flat colour patches of a dyadic test pattern 
for use in colour measurement can not be combined with other elements without affecting 
the constant colour. However, such restrictions can be localized to relatively small parts 
of the test patterau 

20 It is also often desirable to surround each test chart with a region JSlled with a 

colour noise pattem. This allows accurate alignment right to the edge of the test pattern. 

Additional information regarding the nature of each pixel, such as a label 
identifying to which patch in the test pattem the pixel belongs in the case of dyadic test 
pattems, or the texture, colour or spatial frequency of the region in the test pattem to 

25 which the pixel belongs, may be stored as metadata to the file containing the test pattem 
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image when stored on the memory 206. Such information may be used for high level 
comparison of regions within a test pattern image and an image captured using the 
imaging system under test containing the test pattern, and may be a label or a high level 
descriptor* 

5 For high level comparison to work, the correspondence of regions needs to be 

found with pixel or sub-pixel accuracy. This is requires so that it is clear exactly which 
pixels form the region denoted by the higher level descriptor or label. 

With a number of usefiil test patterns described above, as well as the manners in 
which a digital image of the test pattern is formed for each of the arrangements 100, 101 

10 and 102 shown in Figs- 1 to 3, Fig. 13 shows a schematic flow diagram of a method 1000 
of registering two digital images, and then analysing the registered images in order to 
determine characteristics of the imaging system under test In particular, the two nnages 
registered by method 1000 are a test pattem image 1005, which is a digital representation 
of one of the test patterns described above (or a combination of the test patterns), and an 

1 5 image 1010 formed by the imaging system under test containing the test pattem and in the 
manner described with a reference to Figs. 1 to 4, The dimensions of these miages are not 
necessarily equal. 

Method 1000 starts in step 1015 where a coarse registration of images 1005 and 
1010 is performed. In the simplest form the coarse registration is achieved by mechanical 
20 means prior to capturing nnage 1010, for example by using a guide template (not 
illustrated) when placing the test chart 1 10 onto the scanner 120 (Fig. 1). 

In a preferred implementation the coarse registration of step 1015 is performed 
by the processor 205 and in a manner described in more detail below with reference to 
Fig. 14. The output of the preferred coarse registration performed in step 1015 is 
25 re^stration parameters 1020, which are a set of linear transfonnation parameters 
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(Hjj ,^2|2 9^21 » ^22 » -^0 > J^o)* 



The set of linear tramfoimation parameters 



(aj, ,a|2 >^2i »^22'^o >3'o) ^^elates the pixel coordinates {x^y) (in the Cartesian coordinate 
system) to transformed coordinates (^,y) through: 



X 



(10) 



5 When a transformation defined by the registration parameters 1020 is applied to 

the test pattern image 1005, then images 1005 and 1010 should be coarsely aligned, 
generally to within a few pixels. 

Accordingly, after step 1015 method 1000 proceeds to step 1025 where the 
processor 205 uses the set of registration parameters 1020, that is parameters 

10 (an,^i2>^2i><^22'^o>>'o)> transform the test pattern image 1005 to thereby form a 
coarsely registered test pattem image 1030 which is coarsely registered with the image 
1010 formed by the imaging system under test In particular, the value at coordinate 
(3c, in the coarsely registered test pattem image 1030 has the luminance value of the 

pixel at coordinate i^^y) the test pattrai image, where coordinate i^^y) is determined 
15 by an inverse of the liaear transformation represented by the registration parameters 1020 
as follows: 



1 



^11^22 ^12^21 
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(11) 



For coordinates {x^y) that do not correspond to pixel positions, bi-cubic 
interpolation is used to calculate the luminance value for that position firom nei^bouring 



20 values* 



Images 1010 and 1030 are then input into step 1035 where the processor 205 



performs block-based correlation and ia a manner described in more detail below with 
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reference to Fig. 2L The block-based correlation of step 1035 divides the images 1030 
and 1010 into smaller, possibly overlapping blocks, and generates a displacement map 
1037 that represents the displacement that is required to be performed on each block of 
the coarsely registered test pattern image 1030 in order to map the pixels of the blocks of 

5 the coarsely registered test pattem image 1030 with that of the image 1010. The 
displacement map 1037 formed by the block-based correlation of step 1035 is th^ 
interpolated in step 1040, using bi-cubic interpolation, to form a distortion map 1045. 
The distortion map 1045 represents the distortion to sub-pixel accuracy that maps each 
pixel of the coarsely registered test pattem image 1030 to the corresponding pixel in the 

10 image 1010 formed by the imaging device under test. 

The distortion map 1045 together with the registration parameters 1020 resulting 
from the coarse registration performed in step 1015 are then used by the processor 205 in 
step 1050 to warp the test pattem image 1005 to form a registered t^t pattem image 
1055. The warping performed in step 1050 starts by modifying the distortion map 1045, 

15 which rqjresents the distortion that maps the pixels of the coarsely registered test pattem 
image 1030 to pixels of image 1010, to a distortion that maps the pixels of the test pattem 
image 1005 to pixels of image 1010. This is done by adding the linear transformation 
detemiined in the coarse registration step 1015 to the distortion map 1045 as follows: 



D\iJ)^DXUj)^ 



V^12 ^22 J 



(12) 



20 wherein D\Uj) represents the distortion m^ 1045 and D\iJ) represents the 

total warping performed in step 1050, 

Next a new image having the same size as that of image 1010 is formed, with all 
pixel values set to null. This new image, when populated with pixel values, will be the 
registered test pattem image 1055. For each pixel in the new image a pixel value is 



wo 2005/096218 PCT/AU2005/000445 

-31- 

calculated by first detennining the warping applicable to that pixel position. The 
processor 205 tlien calculates the pixel value by determining the pixel value in image 
1005 ttiat corresponds with that warped position. As it is likely that the warped position 
will not correspond with a pixel position in image 1005, interpolation is used for 

5 calculating the pixel value, which is then stored in memory 206. 

The registered test pattem image 1055 typically includes several pixel 
components, for example red, green, and blue intensity components, as well as a label or 
higher level descriptor. Accordingly, all pixel components including the label or higher 
level descriptor are warped in step 1050 to form the registered test pattem image 1055. 

10 By warping the label a direct comparison of image regions can be made by mapping the 
labels of tlie registered test pattem image 1055 onto the imaged test pattem 1010. 

When performing the inteipolation to calculate the pixel values of the registered 
test pattem image 1055, different interpolation methods may be used to interpolate each 
pixel component. For example, the red, green and blue components may be calculated 

15 using bi-cubic interpolation, whereas the integer label may be calculated using nearest- 
neighbour interpolation. The label channel, which is typically formed by integers, is 
interpolated using nearest neighbour interpolation to ensure only integers result in the 
output. Other interpolations techniques would tend to average adjacent labels resulting in 
non-integer labels, or labels with integers that did not occur previously. The nearest 

20 neighbour interpolation of the labels results in a warped label map with labels accurate to 
the nearest half pixel. 

Fig. 26 illustrates the warping of pixel labels. A test pattem image 2600 is 
illustrated having 3 coloured/textured regions 2601, 2602 and 2403 on a white 
background. A label map 2610 of test pattem image 2600 is also illustrated, with the 

25 labels of the pixels in the label map 2610 indicating the region 2601, 2602 or 2403 to 
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which the pixel belongs. In particular, the labels of the pixels in the pixel map 2610 have 
mteger values "0", "1", "2" or **3" dependent on whether the pixel is part of the white 
background, or regions 2601, 2602 or 2603. 

An image 2620 captured of the test pattern image 2600 is fiirther illustrated. As 
5 can be seen, the image 2620 is a greatly distorted version of the test pattern i33aage 2600. 
During step 1050 described above where a registered test pattern image (not illustrated) is 
formed by warping the test pattern image 2600, a warped label map 2620 is formed. The 
labels of the pixels in the warped label map 2630 indicate the region 2601, 2602 or 2403 

to which the pixel belongs. 
10 The warped label map 2630 may be directly superimposed onto image 2620, and 

used as a label layer of image 2620. The process may also be viewed as the 
reintroduction of image metadata (on a pixel-by-pixel basis) after an imaging process 
(such as printing-scanning) that lost the metadata linkage. 

Once the label layer is inserted into the image 2620, all manner of hi^er level 
13 descriptors can be defined and calculated. For example, it might be that a label "3" 
denotes regions 2603 with certain textural properties, as is illustrated in Fig. 26. By 
computing the ensemble pbcel value statistics of all pixels labelled within image 
2620, the global textural properties of region 2623 are known. 

The registered test pattem image 1055 is precisely aligned to the image 1010 
20 formed by imaging system und&r test. The final step of method 1000 is step 1060 where 
the processor 205 uses one or more of the images 1010 and 1055, the distortion map 
1045, and the registration parameters 1020 to analyse the registered images 1010 and 
1055 m order to determine characteristic of the imaging system under test. 

For example, the distortion map 1045 represents the "fine" part of the mapping 
25 of pixels in the imaged test pattOTi 1010 to pixels in the test pattern image 1005. 
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Accordingiy, ia the case of scanner 120 (Fig. 1), the distortion map 1045 represents 
inaccuracies in the scanning process, such as those that may be caused by non-constant 
drive speed, an aspect ratio error, or some other physical errors in the scanner's scanning 
mechanism. The distortion map 1045 also represents the distortions introduced by the 

5 lens of camera 1 60, and inaccuracies in the drive mechanism of the printer 130. 

Another form of the analysis of the quality of an imaging device is the 
measurement of the modulation transform fimction Qs/LTF) of that device. The MTF may 
be measured using any test pattem with a suitable spread-spectrum. Examples of 
appropriate pattems include a two-dimensional M-sequence, greyscale pseudo-random 

10 noise, binarized pseudo-random noise, and two-dimensional perfect bmary arrays (which 
have perfect autocorrelations for certain array sizes; perfect being defined as an 
autocorrelation with no sidelobes). Any pattem having sufficient detail may be used for 
accurate alignment and may be incorporated in the test pattem. 

The MTF is calculated by the processor 205 by dividing each pixel of the 

15 modulus of the Fourier transform of the imaged test pattem 1010 by each pixel of the 
modulus of the Fourier transform of the registered test pattem image 1055, thereby 
producing an image of the two-dimensional MTF of the scanner 120. It is possible to 
localize and repeat the MTF measurement at various locations around the image area, so 
that spatial variations of the MTF may be detected. 

20 With accurate aUgnment it is also possible to estimate the full (complex) optical 

transfer function (OTF), not just its modulus, which is the MTF. The full OTP is 
calculated by the processor 205 by taking the Fourier transform of the system point 
spread function (PSF). The advantage of calculating the OTF is that the system PSF may 
be calculated directly, whereas the more conmion MTF measurement does not allow PSF 

25 estimation. The various transfer functions are only applicable to linear systems, which in 
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practice means that these calculations need to be carried out in the correct colour space, 
with particular care being taken to use the correct contrast model or gamma. The reason 
. alignment is important when performing the OTF measurement is that any distortions in 
the imaged test pattern 1010 will result in phase mrors in the Fourier Transform of the 

5 imaged test pattern 1010, which in turn will affect the OTF measurement. 

Yet further, analysis and calibration of the colour response of the scanner 120 
may be implemented using a colour test pattern containing a distribution of suitably sized 
colour patches, such as the dyadic test pattem described above. Typically the colour 
calibrated test chart 1 10, which is scamxed by the scanner 120 under test, is fabricated on 

10 a printing device, with the colour patches calibrated with respect to a known colour 
standard using a device such as a scanning spectrophometer. Because the pixels in the 
registered test pattem image 1055 are aligned with those in the imaged test pattem 1010 
in the manner described above, the processor 205 has knowledge to which patch each 
pixel belongs. The processor 205 then combines the colour of the pixels of different 

15 patches of the imaged test pattem 1010 by averaging in a suitable colour space, and then 
compares the average colour of each patch with the known speclrophometer value. A 
colour profile may then be generated using maximum likelihood or least-squares 
methods. 

Another form of analysis is termed granularity, and is determined when the 
20 imaging system under test is the printer 130 (Fig. 2). Granularity attempts to measure 
how smooth a patch of solid colour printed on the printer 130 appears to a human viewing 
the patch at a nominal viewing distance. For this analysis, test chart 150 contains the 
dyadic test pattem. The granularity of a patch is calculated by the processor 205 from the 
standard deviation of the luminance values of the patch after it has been jSltered by a 
25 visual transfer fimction (VTF) that rou^y mimics the effect of the human visual system 
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when viewing a piece of paper at a distance of 30cm. The VTF used is described in 
frequency space by: 

where /" = + // and/is measured in cycles/mm on the scanned page. 
5 The filtering is performed by selecting a region of the image, R, twice the size of 

tlie patch and extending around the patch for which the granularity is to be measured. 
The luminance of this region R is then filtered usmg: 

iJ»=3"»(3(i?).FC/;,/,)), (14) 

where 3 and 3"* are the two-dimensional FFT and inverse FFT respectively. 
10 The granularity is then measured by the processor 205 by taking a square region 

of n by n pixels within the patch that covers a significant firaction of the original patch but 
avoids its borders, and measuring the mean and standard deviation of the luminance 
values within this square region of n by n pixels through: 



15 and 



1/2 

n -l/j«i J 

where G is the granularity of the patch, Rij is the luminance value of a pixel in 

the region, and R is the mean of the lununance values of the pixels in the region. The 
final measure G corresponds to how grainy a nominally flat colour appears to a human 
20 observer at a specific (viewing) distance firom the printed test chart 150. The granularity 
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may also be thought of as a measure of the deviation of a colour patch from its mean 
level. 

When evaluating a colour printer, such as a CMYK piinter, it is desirable to also 
measure the alignment of different colour channels. For example, the C channel of an 

5 image printed in the CMYK colour space may be several pixels ofifset from other 
chamiels due to some mechanical inaccuracy in the printer 130. This mis-registration 
leads to noticeable visual defects in the printer's output, namely visible lines of white 
between objects of different colour that should not be present. Detecting and preventing 
such errors is an important problem to be solved in the design and manufacture of colour 

10 printers. 

For this analysis the colour test pattem consisting of the alignment pattern 
superimposed with the pseudo-random noise pattem is used. Also, during performance of 
the block based correlation in step 1035 (Fig. 13), correlation is performed between the K 
channel of the coarsely registered test pattem image 1030 and the K component of the 

15 imaged test pattern 1010, with the K component of the imaged test pattem 1010 
calculated from the RGB values as K - Min(255 R, 255 - G, 255- B). This produces a 
registered test pattem image 1055 in which the black pixels thereof are aligned precisely 
with the black pixels of the imaged test pattem 1010. Due to the possibility that the 
colour chaimels are mis-registered in the printing process, the C, M and Y channels of the 

20 registered test pattem image 1055 may not be precisely aUgned with the imaged test 
pattem 1010. 

The block based correlation of step 1035 is then performed between each of the 
C, M and Y chaimels of the registered test pattem image 1055 and those of the imaged 
test pattem 1010 in order to produce a distortion map for the C, M and Y channels, each 
25 of which being similar in form to the K channel distortion map 1045. Bach of the C, M 
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and Y channel distortion maps shows how the mis-registration of the corresponding 
colour channels with respect of the K channel varies across the printed page. These 
distortion maps, or information derived therefrom, may be supplied to a field engineer to 
allow physical correction of the mis-registration problems, or alternately, they may be 

5 input to the printer 130 for use in a correction circmt that digitally corrects for the printer 
colour channel mis-registration. Printer colour channel mis-registration is typically 
caused by the paper rollers thereof not being exactly centred circular cylinders. 

When measuring the performance of the optical imagiug system of camera 160 
Fig. 3, it is often useful to know the level of distortion present in a camera image. 

10 Typically tlie distortion may be pincushion or barrel distortion. The distortion typically 
depends on the lens used by the camera 160. In the case of a zoom lens the distortion will 
vary with the focal length selected. The distortion map 1045 shows the residual 
distortions that remaui after perspective distortions have been removed- ITie residual 
distortion is further decomposed into radial components (purely related to the distance 

15 from tiie centre of the image) and other components. The other compon^ts are typically 
expected to be negligible in a camera with a symmetrical lens, although precision 
registration allows the measurement of any deviation from the ideal. The common lens 
distortions are related to the cube power of the radial distance from the image centre. If 
the outward radial distortion increases with the distance from the image centre the 

20 distortion is called pincushion distortion, if the inward distortion increases with distance 
then it is called barrel distortion. Calculating a third order least-squares fit to the residual 
distortion map 1045 determines precisely the pincushion or barrel distortion. 

As noted above, in arrangement 102 it is possible to use an LCD instead of a 
more conventional reflective or transmissive test chart. The chromatic aberration of the 
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Optical imaging system of the camera 160 is estimated by the processor 205 by comparing 
separate distortion maps for each of the R, G and B channels in the RGB colour space. 

Care needs to be taken to avoid artefacts of the test chart interfering in the 
measurement A test chart based upon an LCD structure inherently has an RGB channel 

5 displacement due to the displaced R, G, and B picture elements of the display. This 
displacement is known and fixed, and so can be eliminated from the final chromatic 
aberration estimate. The difference in the R, G, and B distortion maps minus the LCD 
structural RGB channel displacement directly represents the total camera chromatic 
aberration. The chromatic aberration may be fiirther analysed to separate ttie optical 

10 chromatic aberration (from the lens) and any chromatic effects related to the Bayer colour 
filtering on the image sensor. 

The chromatic effects described above are usually referred to as lateral chromatic 
aberration. Another type known as axial chromatic aberration does not produce the 
distortion effects above, but instead introduces a change in the power spectral function 

15 shape, and in particular power spectral function width, related to the wavelength of Ught. 
Axial chromatic aberration estnnation is facihtated by repeating the aforementioned 
spatially varying power spectral function measurements, but for three separated channels, 
R,G, and B. The dijfference in the power spectral function widths of the separate channels 
characterises the axial chromatic aberration. 

20 The block based correlation performed by the processor 205 in step 1035 is now 

described in more detail with reference to Fig. 21 in which a schematic flow diagram of 
the steps for performing the block based correlation is shown. Step 1035 operates on two 
images, those being the imaged test pattern 1010 and the coai^ely registered test pattern 
image 1030 resulting from step 1025. The size of images 1010 and 1030 are iV2 by M2 
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pixels and M by Mi pixels respectively. The coarsely registered test pattern image 1030 
is padded appropriately to be the same size as the imaged test pattem 1010. 

During block based correlation, each of the two images are divided in to smaller 
tiles of dimension 2 by Q pixels, with the positions of the tiles corresponding. Fig. 22 

5 illustrates images 1010 and 1030 and the positions of their first tiles 2201 and 2202. 
Correlation is then performed on the tiles 2201 and 2202 to determine the translation that 
best relates the two tiles. A next pair of tiles is then formed from images 1010 and 1030 
by "stepping" through the images 1010 and 1030 by a step size S. . Correlation is then 
repeated between the newly formed tiles. These steps are repeated until all tiles formed 

10 from images 1010 and 1030 by stepprug have been processed. In the preferred 
implementation the parameters are g = 256 and S = 32. 

The output of the block based correlation step is displacement map 1037 that 
represents the warp that is required to map the pixels of the coarsely registered test pattem 
1030 to the imaged test pattem 1010, as well as a confidence measure for each 

15 displacement. The displacement map is a raster image of dimension 
D^^\jiNl + Q-l)/S] by = [(Ml -hQ-Vj/Sj, of displacement vectors and 

confidence estimates. 

Referring again to Fig. 21, step 1035 starts in sub-step 2030 where 
corresponding tiles are formed from images 1010 and 1030. The tiles have to contain 
20 pixel values from images 1010 and 1030 only, hence Ue withia those images 1010 and 
1030. For pixel (ij) in the displacement map 1037, tiie tile from image 1030, and the tile 
from image 1010 have the following coordinates identifying their respective positions in 
images 1030 and 1010: 

tile 1: (LM/2j+(z-Lo,/2j)^-|j2/2iL^l/2j+(/--L^^ (17) 
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tile2: lN2l2M-lDJ2^S^\^l2iiM2l2\^^ (18) 

Processor 205 next in sub-step 2050 applies a window function, such as a 
Hanning window, to each of the tiles, and the two windowed tiles are then phase 
correlated in sub-step 2060. 

5 The result of the phase correlation in sub-step 2060 is a raster array of real 

values. In sub-step 2070 the processor 205 then determines the location of a highest peak 
within the raster array, with the location being relative to the centre of the tile. The 
location of the peak is then stored by the processor 205 in sub-step 2080 into memory 206 
in the displacement map 1037 at position (ij), along with the square root of the height of 

10 the peak as a confidence estimate. If it is determined in sub-step 2085 that more tiles 
exist, then step 1035 returns to sub-step 2030 where a next pair of tiles is formed. 
Alternatively step 1035 ends in sub-step 2090. 

The interpolation performed in step 1040 CPi& 13) is now described in more 
detail with reference to Fig. 24 in which a schematic flow diagram of the steps for 

15 performing the interpolation is shown. The interpolation of step 1040 forms the distortion 
map 1045 from the displacement map 1037. Some values m the distortion map 1045 may 
map pixels in the coarsely registered test pattern image 1030 to pixels outside the 
boundary of the imaged test pattern 1010. This is because the imaging device may not 
have imaged the entire test pattem. 

20 Step 1040 starts in sub-step 1920 where the processor 205 determines the set of 

Unear transform parameters, 1,6,2.621, 622, Ax, A3;), that best relates the displacement 

map 1037. 

The (undistorted) points in the imaged test pattem 1010 are labelled for 
pixel {ij) in the displacement map 1037, and are given by: 
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(19) 



These points {x^^y^) are displaced by the displacement map 1037 to give the 
displaced coordiaates, {x^^ytj), given by 



(20) 



where D(/, J) is the displacement vector part of the displacement map 1037. 
The linear transformation parameters, acting on the imdistorted points give ajBBbie 
transformed points, (x^.y^^), given by 



6,2 b 



22 if J 



(21) 



The best fitting affine transformation is determined by minimising the error 
10 between the displaced coordinates, {xfj.yjj)^ and the aflSne transformed points by 

changing the affine transform parameters ( 6n » ^12 > ^21 > ^22 > ^ » )• The error functional 
to be minimised is the Euchdean norm measure E: 
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(22) 



The minimising solution is 
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10 



where the sums are carried out over all displacement pixels with non-zero 
confidence estimates on the displacement vectors in the displacement map 1037. 

The interpolation step 1040 continues to sub-step 1930 where the best fitting 
linear transforaiation is removed from the displacement map 1037. Each displacement 



map pixel is replaced according to: 
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15 



The displacement map 1037 with the best fitting linear transform removed is 
tlien interpolated using bi-cubic interpolation in sub-step 1940 to a displacement map of 
dimension D^^F by DyP. 

A complication in the mterpolation step 1940 is what to do if the displacement 
map has a pixel with zero confidence in the nei^bourhood of the bi-cubic interpolation 
kernel. If this occurs, the pbcel with confidence is itself substituted by an estimated 
value using an average of neighbouring pixels weighted by their confidence value. If no 
neighbouring pixels have positive confidence, a region-growing algorithm is used to 
determine the pixel value. The interpolated displacement pixel may now be computed 
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using bicubic interpolation using the pixels with positive confidence along with the 
substituted pixels in the displacement map. Finally, in step 1950, the interpolated 
displacement map has the removed best fit linear distortion reapplied according to: 



D\iJ)-^D\iJ)^ 







+ 













(29) 



5 where in this case 

[x,.y,hiN2l2MlS-iDJ2^^^^ (30) 

The map D\ij) forms the output of the interpolation step 1040, which is the 

distortion map 1045. 

Referring again to Fig. 13, the preferred coarse registration performed in step 
10 1015 is now described in more detail with reference to Fig. 14. As was described above, 
numerous different test patterns may be used. In sub-step 1110, the processor 205 
determines whether the test pattern includes an alignment pattem, that is whether the test 
pattern includes the first test pattem described with reference to Figs. 5 to 9. In the 
simplest unplenientation this may be determined from an input received from an operator 
15 of the computer 200. The input also includes the parameters of the test pattem. fii an 
altemative implementation a search for an aligmnent pattem may be performed by the 
processor 205 on the test pattem image. 

If it is determined that the test pattem does not include an alignment pattem, then 
step 1015 continues to sub-step 1120 where rotation, scale and translation (RST) 
20 registration is performed on the luminance channels of the unages 1005 and 1010 
respectively. In the altemative, if it is determmed in sub-step 1110 that the test pattem 
does mclude an alignment pattern, then step 1015 continues to sub-step 1130 where 
invariant pattem detection is performed. Sub-step 1130 is also performed on the 
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luniinance channels of the images 1005 and 1010 respectively. Each of the RST 
registration performed in sub-step 1120 and the invariant pattern detection performed in 
sub-step 1130 is described in more detail below. The output of each of the RST 
registration in sub-step 1120 and the invariant pattem detection in sub-step 1130 is 

5 registration parameters. 

When registering an imaged test pattem image 1010 formed using arrangement 
102 which includes camera 160 and shown in Fig. 3, perspective distortion has to be 
estimated and compensated for. Accordingly, for arrangements including camera 160 
sub-steps 1140 to 1170 described below are p^foimed in order to estimate registration 

10 parameters 1020 whereas, for the arrangements not including a camera, such as 
arrangements 100 (Fig. 1) and 101 (Fig. 2), the output of either of sub-steps 1120 or 1130 
is the registration parameters 1020. 

Accordingly, for arrangements including camera 160 the output of either of sub- 
steps 1120 or 1130 is initial registration parameters 1140. In sub-step 1150 the initial 

15 registration parameters 1140 are used to transform the test pattem image 1005 in a 
manner similar to step 1025 (Fig. 13) to thereby form an initially registered test pattem 
image 1 160 which is coarsely registered with the image 1010 formed by the camera 160. 
The processor 205 then performs a block based correlation between the initial registered 
test pattem image 1160 and the imaged test pattem 1010 in a manner similar to that 

20 described for step 1035 (Fig. 13). The output of the block based correlation step 1170 is 
a displacement map, which is a by Ny image with three components, where the first 

two components of the pixel at location (j\k) represent the displacement {a^j^^A^J^) of 

the pixel at {xj^ ,yj^) in the test pattem image 1005, to its position in the imaged test 

pattern 1010, and the third component represents a confidence estimate Fj^^ for which a 
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non-zero value indicates that the block correlation step 1170 was successful in 
determining a displacement for the block centred on that pixel. This displacement map 
may be used with a standard least squares minimisation algorithm such as the Levenberg- 
Marquardt algorithm to find the values of the perspective transfomation parameters, 
5 ( 6, 1 , » ^13 » ^21 » ^22 > ^23 > ^31 > ^32 )» ^^^^ minimise the following error functional 



^= Zi^ju-^jt-^'j^r-^ihi^-yj.-^'J^^^ (31) 

wherein 

The result of this minimisation is a set of perspective transform parameters 
10 ( , > ^13 » ^21 » *22 » ^23 » ^31 ' ^32 ) rcprcseuts the best fitting perspective transformation 
to the displacement map calculated by the block correlation step 1170. To improve the 
convergence of the niinimisation, the initial values for the perspective parameters 
(6j,,6,2.^i3»^2M^22»^23>*3i»^32) ^® ^ct from thc values of the initial registration 
parameters 1 140 through: 
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Fig. 15 shows a flow diagram of the RST registration of sub-step 1120 in more 
detail. Sub-step 1120 starts in sub-step 1205 where the luminance channels of the test 
pattern image 1005 and the image 1010 fonned by the imaging system under test are 
transformed into complex images 1206 and 1207 respectively. The complex images 1206 
5 and 1207 have both real and imaginary parts. 

Fig. 16 shows a flow diagram of step 1205 of transforming an image 1305 into a 
complex image 1360 ia more detail. Image 1305 may be a test pattern image 1005 or the 
image 1010 formed by the imaging system under test, both of which are real images 
where the pixels are represented by real numbers. The complex image 1360 formed by 
1 0 step 1 205 is one where the image pixels are represented by complex mmibers. 

Step 1205 operates by encodiag directional features of the image 1305 in such a 
way that, when a translation invariant is calculated, images rotated by 180"* can be 
distinguished. 

Step 1205 starts in sub-step 1310 where the image 1305, which is an by Jkf 
15 array of real numbers, is resized by a process of successive halving of the image size until 
the minimum image dimension iST or Af is smaller than 5 12. Halving the size of an image 
may be done through the use of a spatial low-pass filter and down-sampling, as is kuown 
in the art. Halving the size of the image increases the speed of processing by reducing 
data sizes, and may, in certain circumstances, improve the quality of the measurements. 
20 The processor 205 then pads in sub-step 13 15 the resized image produced in sub- 

step 1310 to twice its size by inserting zeros around the boundary of the resized image. 
The zero-padded image formed by sub-step 1315 is then Fourier transformed in sub-step 
1320 through the use of a Fast Fourier Transform (FFT). In sub-step 1325, the result of 
this Fourier transform is then multiplied by a complex spiral of the form: 
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S=.^i±^ ■ (34) 

where (u,v) are Cartesian frequency coordinates in the Fourier domain with 
their origin at the DC offset at ^NI2]XMI2^. The result of the multipUcation in sub- 
step 1325 is then multiplied by a further complex spiral in sub-step 1330, and the result of 

5 this multipUcation is then inverse Fourier transformed through an inverse FFT in sub-step 
1335. The result of sub-step 1335 is then multiplied with the zero-padded image that was 
the result of sub-step 1315. 

The processor 205 also applies an inverse FFT to the result of sub-step 1325. 
The result of sub-step 1345 is then squared in sub-step 1350. 

10 Next the result of sub-step 1340 is subtracted in sub-step 1355 from the result of 

sub-step 1350 to form the complex image 1360. As set out above and also referring to 
Fig. 15, if step 1205 is applied to the test pattem image 1005, liien complex image 1206 
results, whereas if step 1205 is appUed to image 1010, then complex image 1207. 

With sub-step 1205 described in detail and referring again to Fig. 15, step 1120 

15 continues in sub-step 1210 where the processor 205 generates from the complex images 
1206 and 1207 images 1211 and 1212 that are substantially invariant to translations in the 

images 1005 and 1010. 

Fig, 17 shows a more detailed flow diagram of sub-step 1210, which operates on 
complex image 1360, which may be any one of complex images 1206 or 1207 formed by 
20 the preceding sub-step 1205. Step 1210 starts in sub-stq) 1410 where the processor 205 
applies an FFT to the complex image 1360 received as input The result of the FFT 
applied in sub-step 1410 is an image with complex pixel values, and is converted in sub- 
step 1420 to an image having real pixel values only by taking the magnitude of each 
complex value. The processor 205 then applies, m sub-step 1430, an inverse FFT to the 
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real image resulting from sub-step 1420 to produce a further complex image, which in 
turn is converted in sub-step 1440 to a further real image 1450 by adding the real aad 
imaginary parts of each pixel. If the complex image 1206 was received as input to step 
1210 then the real image 1450 produced is image 1211 (Fig. 15), whereas in the case 

5 where the complex image 1207 was received as iaput to step 1210 then the real image 
1450 produced is image 1212 (Fig. 15) 

Referring again to Fig. 15, after performing sub-step 1210, sub-step 1120 
continues in sub-step 1215 where the images 1211 and 1212 are resampled into a log- 
polar space to form images 1216 and 1217. Resampling into the log-polar space performs 

10 a mapping from a point having coordinates (x^) in the Cartesian coordinate space to a 
point with coordmates (r,6), where coordinate r corresponds to the log of the distance of 
Cartesian coordinates (x^) to the origin of the Cartesian coordinate space, and 0 
corresponds to the angle that the point (x^) makes with the origin. Hence: 



r oc log(V?"+^) ^ ^^^^ 



15 dec tan 



^1 



(36) 



If an image having width FT and height H is resampled to the log-polar domam or 



space, then the coordinate r would range between logi-jw^ -^H^ 12) at the high end, 
and negative infinity at the low end. This is clearly not possible to realize, and it is 
necessary to clip tlie coordinate r at some small value of r. This clipping has the effect of 
20 excluding a disk of pixels from the centre of the image. 

In the preferred implementation a range of log r is chosen such that a disk of 
radius approximately 5% of the width of the image is excluded. Such a choice gives a 
suitable trade-off between losing image information, and producing a log-polar 
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resampiing which contains an adequate contribution of values firom all areas in the input 
images. 

Fig. 18 illustrates some characteristics of resampling an image 1510 having 
Cartesian coordinates to an image 1520 in the log-polar domain. Image 1510 is 
5 surrounded by a region 1540 which maps to zero values in image 1520. Disk 1530 
contains pixels excluded from the resampling. The distance to any point in the image 
1510, excluding disk 1530, and including the surrounding region 1540 from the origin 
ranges from 0.05 to 1. In the log-polar space that range resamples to the range -3 to 0. 

Feature 1570 in image 1510 resamples to feature 1570 in the log-polar image 
10 1520. It can be seen that approximately two-thirds of the Cartesian image (for radius r 
between 0.36 and 1.0) is mapped to approximately one-third of the log-polar image (for 

log r between -1 and 0). 

Because the log-polar resampling is highly non-linear, the log-polar resampled 
images 1216 and 1217 QFig. 15) are preferably created to be larger than the original 
15 Cartesian images 121 1 and 1212, thereby ensuring that pixel information, other than that 
from the central disk, is not lost. A log-polar image in which the log-radial axis is 
approximately double, and the angular axis is approximately six tknes the width of the 
input image, will result in a log-polar transformation in which little information is lost due 
to the resampling. 

20 Assume the width W of the input image is the larger of the two image 

dimensions W and H, The resampling to the log-polar domain of sub-step 1215 starts by 
forming an empty log-polar image with a radial axis of length X-2W and a preferable 
angular axis of length Y^W. 

The processor 205 then calculates for each pixel with coordinate Qdy) in the 

25 log-polar image an angle and radius (r, 6) in the input image as follows: 
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r = a exp(log(i?, / «>' / AT') (37) 
^ = tan . I .,^1 



where ii, = -jw-+H- 12. (39) 

Parameter « controls the radius of the disk in the centre of the input image from 
5 which of pixels are excluded during the resampling. The preferred radius of 5% of the 
maximum radius, which is Ru is achieved with parameter a = 0.05 . 

The log-radius log(r) and angle 6 (x^) are then converted to Cartesian 

coordinates as follows: 

;c = rcos^"fL-^/2j (40) 

10 y:=rmi9'\-\Yn\. (41) 

Next the value from the input image at position {x^) is interpolated, using bi- 
cubic interpolation. If the position (pc^) falls outside the original image, then a value of 0 
is used. This interpolated value is the value attributed to coordinate (x'y ) in the log-polar 
image. 

15 Referring again to Fig. 15, the log-polar resampled images 1216 and 1217 

formed by sub-step 1215 are then correlated in sub-step 1220 by the processor 205, using 
phase correlation. During phase correlation the FFT of a first input image, which is 
image 1216 in this case, is multiplied by the complex conjugate of the FFT of a second 
input unage, which is image 1217 in this case, and the result of this mtiltiplication is 

20 normalised to have unit magnitude. An inverse FFT is then applied to the result of the 
normalisation. 
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The result of the correlation in sub-step 1220 is an image containing a magnitude 
peak, the location of which represents the scale and rotation relating the images 1005 and 
1010. Accordingly, peak detection is performed on the result of the correlation in sub- 
step 1225 in order to determine the location of the peak. Processor 205 uses the location 

5 of the peak in sub-step 1230 to determine rotation and scale parameters that relate the two 
images 1005 and 1010. Let the location of the peak be (j>^,Py) and let Xand Fbe the 
width and height respectively of the log-polar resampled image 1216. Coordinate Py, 
with a range of [0 . . .7 - 1] , represents an angle between -7r/2 radians for Py^Q and 7r/2 
radians for Py-Y . Coordinate p^, with a range of [0„,X-1], represents a scaling 

10 factor, with p^-0 corresponding to a scaling factor of a , p^ =^\X I2\ corresponding to 
a scaling factor of 1, and p^^X (which does not appear in the image) corresponding to 
a scaling factor of 20. The preferred value of a is 0.05, though other values may be used 
From peak location { , ) the angle 0 and scaling factor s is derived as: 

e^27^iiYl2\-'Py)lY (42) 

15 s = exp(log(a(Lx/2j" p,)l\_XI2^) (43) 

Processor 205 then uses the rotation and scale parameters to rotate and scale the 
test pattern image 1005 in sub-step 1235, using bi-cubic mterpolation. Images 1005 and 
1010 now have the same oriratation and scale. The result of sub-step 1235 is then 
coirelated with the imaged test pattem 1010 in sub-step 1240, again using phase 
20 correlation as described above. In sub-stqp 1245 the processor 205 performs peak 
detection on the result of the correlation in sub-step 1240. The location of the peak is 
used by the processor 205 in sub-step 1250 to determine the translation parameters 
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(JCo .3^0) t^^at relate images 1005 and 1010. Let (p^j^y) be the location of the peak detected 
in step 1245, then the translation parameters (xq , ^o) are: 

x^=lN/2}-p, (44) 
y,=lM/2j-p, (45) 



where iV and M are the width and height respectively of the test pattern image 



1010. 



Referring again to Fig. 14, sub-st^ 1130 whore invariant pattern detection is 
performed is now described in more detail with reference to Fig. 19. As set out above, 
sub-step 1130 is performed if the test pattern includes an ^gnment pattern. Sub-stq) 
1130 starts in sub-step 1710 where the luminance channel of image 1010 is resized -by a 
process of successive halving until the resultant image is sized such that the smallest of 
the width and height is m the range 256 to 511 pixels. Sub-step 1710 is performed to 
improve the efficiency of the steps fliat foUow. The successive halving may be performed 
by convolving the image with a low-pass filter and decimating the result of the 
> convolution. The processor 205 then performs a two-dimensional FFT in sub-step 1720 
on the resulting resized image. 

Preferably, before comjjuting the FFT in sub-step 1720, the image luminance 
values near the image edges are first attenuated so that the image luminance values fade 
to zero gradually and smoothly towards the edges of the rescaled image. The attenuation 
0 of luminance values at the edges of the rescaled image removes artefacts typically formed 
by the FFT. 

Step 1130 continues in sub-step 1730 where the processor 205 resanqjles the 
result from step 1720 iato a quasi-polar frequency space. A complex image is produced 
wherein horizontal rows thereof correspond to radial sUces in the two-dimensional FFT 
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that resulted from sub-step 1720. The angular spacing and flie radial scaling need not be 
constant. This may be achieved by a direct polar transform of the two-dimensional FFT 
which resamples the FFT onto a polar grid using bi-cubic interpolation. Whilst simple, 
this method produces artefacts which can adversely affect detection of the embedded 

5 aligmnent pattern. The preferred method of performing sub-step 1730 is described below. 

The invariant pattern detection step 1130 continues in sub-step 1750 where a 
one-dimensional Fourier transform of the one-dimensional basis function is performed, 
with the basis function being the fimction firom which the one-dimensional scale invariant 
patterns embedded into the test pattem image 1005 are formed, such as the basis function 

10 given by Equation (1). Altematively, the basis function may be mathematically 
transformed. 

Next, the transform of the basis function resulting from sub-step 1750 is 
multiplied in a pixel by pixel fashion in sub-step 1760 with the complex conjugate of the 
values of the ou^ut of sub-step 1730 along horizontal rows for all angle values. Values 

15 along horizontal rows represent radial lines in the two-dimensional FFT. The complex 
pixel values resulting from sub-step 1760 are then normahzed by the processor 205 so 
that the pixel values have unit magnitude. Sub-step 1770 follows where the one- 
dimensional IFFT is performed on the output of step 1760 along horizontal rows. The 
result of sub-step 1770 is a complex image with peaks in its magnitude at locations 

20 corresponding to the orientations and scales of the one-dimensional basis functions within 
the image 1010. The processor 205 in sub-step 1780 detects such peaks in the manner 
described in more detail below with reference to Fig. 25. 

Finally, in sub-step 1790 the locations of 4 of the peaks detected in sub-step 
1780 are used to determine the affine parameters that relate the images 1050 and 1010. In 

25 particular, the affine transformation described by linear transfomiation parameters 
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ia^i,a^2^^2\^^22»^Q>yo) ^^PS original set of one-dimensional basis fianction 

parameters, those being radius and angle , to radius and angle fi^ , is deteamined 

from the 4 selected peaks. 

The processor 205 does so by first sorting the peaks detected in sub-step 1780 

5 into order of their magnitude. The peaks are also filtered such that peaks that are within 
10 pixels of a peak with a higher magnitude is removed from the list of peaks. The 
remaining top 64 peaks, if that many exist, are then fintiier processed by selecting in turn 
each possible combination of 4 peaks and performing the following analysis, keeping 
track of which combination of 4 peaks best satisfies the conditions of this analysis. The 

10 radius and angle fi^ of each peak are computed from the (;c^) offeet of that peak in the 

quasi-polar map as follows: 



The input image is of size iW,X* + Y') pixels. Let 



(46) 



Ify < r, then: 



ys =y-Y2 



15 



Pi =;r/2-tan 



(47) 




else if ^ >= Y, 



wo 2005/096218 PCT/AU200S/000445 

-55- 

-I -^2 



/3i=7V- tan- (48) 

As mentioned with reference to Equation (4), the set of preferred parameters n 
and Oi has been specially chosen so that the axes of symmetry of the one-dimensional 
basis functions they represent intersect at points that define line segments that have 
5 certain ratios of lengths. As the ratios of lengths are invariant mder affine 
transformations, the first condition which the combination of 4 peaks must satisfy is that 
line segments generated therefirom should have ratios of lengths that correspond to those 
of the axes of symmetry of the patterns embedded. In the case where the ratios of lengths 
do not con-espond to those of the axes of symmetry of the patterns embedded the 
10 combination of peaks cannot correspond to the four original basis patterns modified by an 
affine transform and this combination is discarded. 

As previously described, the radial and angular coordinates of a peak, 5^ and>5;, 

describe the axis of symmetry of one of the one-dimensional scale invariant pattems 
embedded in the test pattern. Rather than determine ttie affine transform applied to the 
15 test pattem image 1005 through the changes in these line parameters directly, the affine 
transform is determined firom the intersection points of the 4 axes of symmetries specified 
by the 4 selected peaks. The intersection of two axes of symmetry represented by 
parameters ^nd {s„,,fi^} is labelled {xf^.y^^,), and is given by tibie matrix 

equation; 



20 



1 



sin /3f^ — sin yS^, 
sinC^^ -/?^)l^cos/?^ cos^^ ) 



ttt 



(49) 
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Clearly there is no intersection if the lines are parallel, and so the equivalent 
constraint sinOS^ - fi,)^^ is imposed. In practical situations sin^C^j^ -y3^)>0.25 is 
sufficient to ensure good localization of the intersection point (^jtm,3^fa«)^ Now, the 
parametric equation of a line specifies the linear distance of any point on that line relative 
5 to the perpendicular bisector of that Une that passes through the origin. In the current case 
of four mutually non-parallel lines, each line has three intersection points along its length 
and the ratio of the mtersection intervals remains invariant to afifine distortions. The 



distance , along the li^ line where the line intersects, is given by 



m 



sinCe.-Aj 



(50) 



10 The above equation is then enximerated for all combinations X^^ fox k^m and a 

table generated which contams the locations along lines: 



^3 
^2 



- 



^14 
^4 



(51) 



At this stage it is useful to order the parameters by size 



{^lanL^ > {Knl,, > {^*.L„>^ = 1 ^ ^ ^f cach hnc h and find the length ratios R,^ : 



15 



jR^*=:min 



{^hn } max 



{^hit }iidn {^km Imax ~ {^km } 



(52) 



This generates 4 ratios firom the 4 axes of symmetry. There are also 4 ratios that 
may be generated firom the original set of one-dimensional basis fimction parameters 
and a. . If we denote these ratios as then we define the error in the ratio measure for 



the selected set of 4 peaks as: 
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If the error Eratio is greater than 0.1 the set of peaks is discarded. Alternatively, if 
the error Erauo is less than 0.1, then the processor 205 applies a linear least squares fitting 
model to determine the best fitting affine transform that maps the set of intersection 

5 points of the axes of symmetry generated by the 4 selected peaks back to the original set 
of intersection points of the axes of symmetry of the embedded pattern. 

The preferred method of performing sub-step 1730 (Fig. 19), that is resampling 
the result from step 1720 into a quasi-polar frequency space, is now described in more 
detail with reference to Fig. 20. Sub-step 1730 starts in sub-step 1810 where the 

10 processor 205 replicates the input image (the result firom stqp 1720), having size (X^^Y% 
into two copies. In sub-step 1820, the first copy is padded with zeros in the direction to 
a width of jr=2*MAX(X',r^, resulting in an image of size {WJ"), The padding is 
performed so that colunm ojffset [^7 2 J in the first copy corresponds to column oJBfset 

Li^ / 2 J in the padded image. 

« 

15 Also, in sub-step 1830, the second copy is padded with zeros in the 7 direction to 

a height of W. The padding is performed so that row offset \ Y'I2\ in the second copy 
corresponds to row offset \ WI2\ in the padded image. Sub-step 1830 is followed by 
sub-step 1840 where the padded image resulting from sub-step 1830 is rotated by 90 
degrees, resulting in an image of size (Wy!C% 

20 In sub-steps 1850 and 1860 the results firom sub-steps 1820 and 1840 

respectively are transformed by the processor 205 by computing the one-dimensional 
Fourier transform is of each row. 
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This is followed by sub-steps 1870 and 1880 where the results from sub-stqps 
1850 and 1860 respectively are transformed by the processor 205 by computing 
individual chirp-Z transforms on each of the columns. Each chirp-Z transform is 
performed to preserve the centre position of each column, at positions \y*/2} and 

5 L;^72j within the colunms of the results from sub-steps 1870 and 1880. 

The scaling factors for each column z in the results from sub-steps 1870 and 
1880 respectively are: 

* m,=L^/2j/(z-Li^/2j) (54) 

Each scale factor m^is negative for z<lw/2}, corresponding to a vertical flip. 

10 Where the scaling factor is undejBned for z = L'^/2j, the central pixel position is 

replicated across the whole colujaon. 

Assuming a square image, the results from sub-steps 1870 and 1880 represent 
quasi-polar transforms of the Fourier Transforms of the resized, windowed input image, 
with the result from sub-step 1870 having angles within the range [-7r/4,.'K/4], and the 

15 result from sub-step 1880 having angles m the range [^/4„ SttM]. If the input image is 
rectangular, the angular ranges will be from [-atan2(r,^)..atan2(F,Z^)] and [atan2(F^) 
..7r-atan2(r JC)]. Because each row of the quasi-polar transform contains positive and 
negative radii, it has all angles within [0.*2x| radians. 

Sub-step 1730 ends in sub-step 1890 where the processor 205 combines the 

20 images resulting from sub-steps 1870 and 1880 to form an output image of dimension 
{JV^r-^JC) by repUcating the pixels of the image resulting from sub-stqp 1870 into the top 
part of the output image and replicatmg the pixels of the image resulting from sub-step 
1880 into the bottom part of the output image. 
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The peak detection performed in sub-steps 1225 (Fig. 15), 1245 (Fig. 15) and 
1780 (Fig. 19) is now described in more detail with reference to Fig. 25 where a flow 
diagram of a method of performing peak detection on a correlation image 1610 is shown 
in more detail. Correlation image 1610 may be a real image or complex image. Step 
5 1780 starts in sub-step 1620 where the processor 205 forms a list of peaks in the 
correlation image 1610, that is all points in the correlation image 1610 where the 
magnitude of the point is larger than neighbouring points. In sub-step 1630 the pomts are 
sorted in order of the magnitude of the pixel value. 

However, peaks may occur in noisy regions, causing many peaks to be clustered 
10 close together. In the case of sub-step 1780, the manner in which the parameters of the 
embedded patterns were chosen establishes that there should be only one peak in any one 
region. Also, in the case of sub-steps 1225 and 1245 only one peak should exist in the 
correlation image 1610. Accordingly, only the largest peak within a certain radial 
threshold is considered, with a preferred radial threshold being 10 pixels. In sub-step 
15 1640 each peak in the sorted Hst is considered in decreasing order of its magnitude, and 
any peak in the list that is lower in the list (smaller magnitude) and within the radial 
threshold of the peak being considered is removed from the list. 

In sub-step 1650 that follows the processor 205 truncates the sorted list of peaks 
to a length equal to the number of peaks that are expected. In the case of sub-step 1780 
20 this is the number of aUgnment patterns embedded into the test pattern, which is 4 in the 
preferred implementation, hi the case of sub-steps 1225 and 1245 there should be only 
one peak. The positions of these peaks are to be determined with high precision* In sub- 
step 1660 a next peak is selected. In sub-step 1670 the processor 205 inputs a 27 by 27 
region centred on the location of the peak being considered to an FFT, followed by a 
25 chirp-z transform which zooms m on the peak by a factor of 27. The chirp-z transform 
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allows computation of the discrete Fourier transform (DFT or the inverse DFT) with 
arbitrary spacing. The method works by expressing the DFT as a discrete, cyclic 
convolution. Because such convolutions can be implemented using FFTs it is possible for 
the entire computation to take advantage of the FFT speed By suitable choice of spacing, 
5 the chirp-2 bfansform becomes an interpolation technique, so that, for example, a DFT is 
finely sampled (that is to say zoomed) over a selected region. 

The pixel in this 27 by 27 image with the highest magnitude is determined in 
sub-step 1680, and the sub-pixel location of this peak is determined ushag a biparabohc 
fit This sub-pixel accurate peak location is the output of the peak detection st^. 
^0 In sub-step 1685 the processor 205 determines whether more peaks are to be 

processed. If more peaks exist, then step 1780 returns to sub-step 1660 firom where the 
next peak is selected and processed. Alternatively ste^ 1780 ends. 

The foregoing describes only some embodiments of the present invention, and 
modifications and/or changes can be made thereto without departing firom the scope and 
15 spirit of the invention, the embodiments being illustrative and not restrictive. 

For example, in the implementation(s) described above the luminance channels 
of the test pattern image 1005 and unaged test pattern 1010 are used for registration. 
However, some other combination of channels may be used, such as the chrominance, or 
each single channel separately, such as the red, green or blue channeL 
20 It is sometimes desirable to pad the test pattern images 1005 with a colour that is 

similar to that of the material on which the test chart 110, 150, or 170 has been fabricated 
or printed. For mstance, if the test chart 110, 150, or 170 is printed on white paper, the 
test pattern images 1005 may be surroxmd by an area of white pixels to allow registration 
of the images right to the edge of the image. 
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Furthermore, the correlation performed between blocks in the block based 
con-elation (step 1035) is described as single channel correlation. Two colour channels of 
the hnages 1030 and 1010 may be nsed as real and imagmary parts of a complex image 
and complex phase correlation is then performed between the (complex) blocks. 
5 Also in the implementation of the block based correlation step 1035, the blocks 

selected for conrelation are overlappmg and evenly spaced. Non-overlapping blocks, or 
variably spaced and sized blocks may be used. Yet a further variation is to use non- 
square blocks. 

Yet another modification to the block based correlation step 1035 is to, before 
10 the blocks are correlated, decimate or scale the images 1030 and 1010 to reduce the 
amount of computation necessary to perform the correlation step. 

Multiple appUcation of the block based correlation step 1035 may be performed, 
where the warped test pattern image 1055 replaces the coarsely registered test pattern 
image 1030 as the input to subsequent block based correlation steps. The distortion maps 
15 so formed are then combined through composition and bi-cubic interpolation. This 
allows the application of the block based correlation step at multiple block sizes and step 
sizes to produce even better registration results at the cost of additional computation. 

hi the context of this specification, the word "comprising" means "including 
principally but not necessarily solely" or '^having" or "including", and not "consisting 
20 only of\ Variations of the word "comprising", such as "comprise" and "comprises" have 
correspondingly varied meanings. 



